Multimodal FeedForward Self-organizing Maps
نویسندگان
چکیده
We introduce a novel system of interconnected SelfOrganizing Maps that can be used to build feedforward and recurrent networks of maps. Prime application of interconnected maps is in modelling systems that operate with multimodal data as for example in visual and auditory cortices and multimodal association areas in cortex. A detailed example of animal categorization in which the feedworward network of self-organizing maps is employed is presented. In the example we operate with 18-dimensional data projected up on the 19-dimensional hyper-sphere so that the “dot-product” learning law can be used. One potential benefit of the multimodal map is that it allows a rich structure of parallel unimodal processing with many maps involved, followed by convergence into multimodal maps. More complex stimuli can therefore be processed without a growing map size.
منابع مشابه
Feedback in Multimodal Self-organizing Networks Enhances Perception of Corrupted Stimuli
It is known from psychology and neuroscience that multimodal integration of sensory information enhances the perception of stimuli that are corrupted in one or more modalities. A prominent example of this is that auditory perception of speech is enhanced when speech is bimodal, i.e. when it also has a visual modality. The function of the cortical network processing speech in auditory and visual...
متن کاملستفاده از خوشهبندیهای پیاپی نقشه خودسازمانده برای بهبود پیشبینی پیک بار الکتریکی روزانه مبتنی بر شبکههای عصبی پیشخوراند
متن کامل
Semantic Concept Detection from News Videos with Self-Organizing Maps
In this paper, we consider the automatic identification of video shots that are relevant to a given semantic concept from large video databases. We apply a method of representing semantic concepts as class models on a set of parallel Self-Organizing Maps trained with multimodal low-level features. The presented experiments were conducted using a set of 170 hours of video containing recorded tel...
متن کاملA Comparative Analysis between Conventional Approaches and Connectionist Methods in Pattern Recognition Tasks
The purpose of this work is to compare statistical and connectionist techniques for patterns recognition. Connectionist approach is based on feedforward artificial neural network, self-organizing maps or hybrid algorithms which are also compared. An alternative preprocessing method to pattern recognition problems is also suggested.
متن کاملGeneralized Winner-Relaxing Kohonen Self-Organizing Feature Maps
We calculate analytically the magnification behaviour of a generalized family of self-organizing feature maps inspired by a variant introduced by Kohonen in 1991, denoted here as Winner Relaxing Kohonen algorithm, which is shown here to have a magnification exponent of 4/7. Motivated by the observation that a modification of the learning rule for the winner neuron influences the magnification l...
متن کامل